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1 Introduction 



Various properties and structure of compact sets in the convex analysis context have been 
studied thoroughly starting from the middle of the last century. An extensive bibliography 
is devoted to this theme (see [H [2], [3] and references therein). The most important results 
are well known: the Krein-Milman theorem on convex hulls of extreme points, the Choquet 
theory on barycentric decompositions, properties of convex hulls (envelopes) of functions 
on convex compact sets. Some of the classical results have been extended to non-compact 
sets in locally convex spaces by Edgar [U [5] and Bourgin [6j [7] . Such generalizations are 
interesting not only theoretically, but also very important in applications, for instance, in 
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mathematical physics j8], in quantum information theory j9], and so on. Of course, classical 
results of convex analysis cannot be extended to all non-compact sets. One has to postulate 
some special properties of these sets. The Choquet theory, for example, has been generalized 
to sets possessing the Radon- Nicodim property jl]. In [pj the several results on continuity of 
convex hulls of functions were extended to a special class of sets called n~ compact sets. This 
class, characterized by the special relation between the topology and the structure of linear 
operations, is the main subject of this paper. 

Problems of continuity of convex hulls of continuous functions (see definitions in the 
next section) have been studied in the literature since the 70s of the last century. Under 
what conditions on the convex compact set A is the convex hull of any continuous (another 
assumption: concave continuous) function defined on A continuous? Vesterstrom in [TO] 
showed that a necessary and sufficient condition for this is the openness of the barycenter 
map. He conjectured the equivalence of the continuity of the convex hull of any continuous 
concave function (this property was called by Lima the CE-property [TTJ) to the continuity 
of the convex hull of any continuous function (called in [9J the strong CE-property). This 
conjecture was proved by O'Brien in [12], who, moreover, showed the equivalence of the both 
CE-properties to the openness of the convex mixing map 

(x,y,X) ^ \x + (1 - X)y 

(the so-called "stability property for convex sets" [131 US])- The question arises if these 
results can be extended to non-compact sets A. The first step towards the solution of this 
problem was made in [pj, where so-called /i-compact sets were defined. Some results on the 
CE-properties were generalized from compact sets to the class of /i-compact sets. This, in 
particular, made it possible to derive several results concerning the entropic characteristics 
of infinite-dimensional quantum channels and systems. 

In this paper we analyze the /i-compactness property in detail, consider several examples 
that are important in applications, extend some classical results of convex analysis known 
earlier for compact sets only, in particular, the Vesterstrom-O'Brien theorem, to the class 
of /i-compact sets. 

The class of /i-compact convex sets is defined by the requirement of weak compactness 
of preimages of all compact sets under the barycenter map. This property is not purely 
topological, it expresses certain relations between topology and the structure of linear op- 
erations. This class contains all compact sets as well as some important non-compact sets, 
for example, the set of density operators in a separable Hilbert space, /i-compact sets do 
not possess many properties of compact sets, such as the boundedness of continuous func- 
tions, the Weierstrass theorem, and so on. Nevertheless, as we shall see, a lot of results of 
the Choquet theory and of the Vesterstrom-O'Brien theory can be extended to this class. 
Moreover, we give arguments showing that the class of /i-compact sets is, in some sense, the 
largest class, to which the Vesterstrom-O'Brien theory can be extended. 

This paper is organized as follows. In Section 2 we derive basic properties of /i-compact 
sets. By a simple example we show that several results true for /i-compact sets become 
false after a slight relaxing this assumption to pointwise /i- compactness (this property is 
defined by the requirement of weak compactness of sets of measures with fixed barycenter). 
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Further we consider examples of /i-compact sets. We show, in particular, that the bounded 
part of the positive cone in the space l p for p — 1 is /i-compact, while for p > 1 it is not 
even pointwise //-compact. The /i-compactness of the set of Borel probability measures on 
a complete separable metric space is established. This result makes it possible to show that 
the convex closure operation respects the /i-compactness property. 

In Section 3 we complete the generalization of the Vesterstrom-O'Brien theorem to the 
class of /i-compact sets, started in [9] . The /i-compact version of the main result from [12] is 
proved. This establishes the equivalence of the continuity property for convex hulls of con- 
cave bounded continuous functions and the continuity property for convex hulls of arbitrary 
bounded continuous functions. We construct an example confirming our assumption that 
/i-compact sets form the largest class of convex metrizable sets, for which this extension is 
possible. In Section 4 we apply some of our results to the quantum information theory. In 
Section 5 we discuss possible generalizations and formulate several open problems. 

2 On /i-compact sets 

2.1 Definitions and basic properties 

In Sections 2 and 3 we assume the set A to be a closed bounded subset of a locally convex 
space. We also suppose that the convex closure co A of A defined as the closure of its convex 
hull co A is a complete separable metric space. We use the following notation: 

extr A is the set of extreme points of A; 

C(A) is the set of continuous bounded functions on a set A; 

P(A) and Q(A) are the sets of convex and, respectively, concave continuous bounded func- 
tions on a convex set A; 

cof and cof are the convex hull and the convex closure of a function / on a convex set; 
they are defined as the maximal convex and the maximal convex closed (that is, lower 
semicontinuous) functions not exceeding /, respectively [5], [IB]; 



= \ {^i}i=i | 7T?. > 0, ^iLi 71 "* = 1 f is the simplex of all probability distributions with 



n < +oo outcomes. 

Let M(A) be a set of all Borel probability measures on the set A with the topology of 
weak convergence [T71 [TS] . 

With an arbitrary measure \i G M(A) we associate its barycenter (average) b (/i) G co^l, 
which is defined by the Pettis integral ([171 [19]) 



1 This means that the topology on the set co A is defined by a countable subset of the family of seminorms 
generating the topology of the entire locally convex space, and this set is separable and complete in the metric 
generated by this subset of seminorms. 




(1) 
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Let M X (A) be a convex closed subset of the set M(A), which consists of measures /x such 
that b(/i) = x G co A. 

We denote by {7r i? x,i} the measure with a finite or countable number of atoms {x{\ with 
weights {7Tj}. Let M i (A) and M f x (A) be subsets of the sets M(A) and M x (^4) respectively 
that consist of measures with finite supports. 

The barycenter map 



is continuous, which can be shown easily by applying Prokhorov's theorem. Therefore, the 
image of any compact set in M(A) under map ([2]) is compact in co„4. The inverse map 
b 1 may not possess this property. Generalizing the definition from [U] consider the class of 
convex sets, for which the map b 1 takes compact sets to compact sets. 

Definition 1. The set A is called ^,-compact if the preimage of any compact subset of 
co A under barycenter map (Ejj is a compact subset of the set M(A). 

An arbitrary compact set is /i-compact. Indeed, the compactness of A implies the com- 
pactness of M(A) [IB]- By using Prokhorov's theorem one can derive the following criterion 
of /i-compactness [9J. 

Proposition 1. A convex set A is ^,-compact if and only if for any compact set K. C A 
and for any e > there is a compact subset K, e C A such that for any x G /C and 
for any its expansion x = J2i=i i> where {xj}" =1 C A, {Aj}" =1 G < p n , we have 

z2i-. Xi eA\K e < £ - 

Proposition [1] and basic properties of the set M(A) yield the following criterion of /i-com- 
pactness, which is most convenient for applications. 

Proposition 2. A convex set A is ^-compact if and only if there is a family F(A) of 
nonnegative concave functions on A with the following properties: 

• the set {x e A \ f(x) < c} is relatively compact for any function f G -^(^4) and for any 



• for any compact setK^A there is a function f G F(A) such that sup^g^ f(x) < +oo. 

Proof . The sufficiency easily follows from Proposition [1] (see |9j). Let us prove the necessity. 
Let %3(A) be the set of lower semicontinuous functions (p on A taking values in [0, +oo] and 
such that {x G A \ tp{x) < c} is compact for any c > 0. Applying Prokhorov's theorem 
(see [17], example 8.6.5, p. 236) we conclude that the set M C M(A) is relatively compact 
if and only if there exists a function ip G 2J(^4) such that 



M(A) 3 \i i-)> b(fj) G co A, 



(2) 



c > 0; 



sup / 

/i£M J a 




Consider the following family of concave nonnegative functions 




sup / 

fi€M x (A) J A 
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on the set A. This family possesses the first characteristic property of the family F(A), 
which follows from the continuity of the barycenter map. The second property follows from 
the /i-compactness of the set A. 

□ 

Remark 1. This is interesting that for all convex non-compact, but //-compact sets con- 
sidered in Subsection 2.2 there exist families F(A) that consist of affine lower semicontinuous 
functions. 

There exists a criterion of //-compactness of a convex set in terms of properties of functions 
defined on this set [20J. More precisely, it is shown that the /i-compactness is equivalent to 
the continuity of the operator of convex closure (that is, the double Fenchel transform) with 
respect to monotone pointwise converging sequences on the classes of continuous bounded 
and of lower semicontinuous lower bounded functions. 

Let us note that continuous affine maps do not necessarily respect the //-compactness 
property. Nevertheless, we have the following simple consequence of Propositions [1] and |2j 

Proposition 3. Let A and B be convex setsB and if be a continuous affine map from A 
to B such that for any compact set C C B its preimage tp~ l (C) is compact in A. Then 

1) the fi- compactness of B implies the fi- compactness of A; 

2) if ip is surjective, then the fi- compactness of A implies the fi- compactness of B. 

The operations of intersection, taking convex closure and Cartesian product respect 
/i-compactness: 

Proposition 4. 1) A closed subset of any fi-compact set is fi-compact. 

2) The convex closure of any fi-compact set is fi-compact. 

3) The Cartesian product of a finite or countable family of fi-compact sets is fi-compact 
(in the topology of coordinate-wise convergence). 

Proof . 1) This follows directly from Definition [TJ 

2) Combining the /i-compactness of the set A and proposition 2 from [9] (its proof for 
our class of sets is literally the same as in that paper) we obtain that the barycenter map 
fi I—)- b(/i) is a continuous affine surjection from M(A) to co.4. satisfying the assumptions 
of Proposition [3j Applying the second part of that proposition and Corollary H] from the 
next subsection we conclude that the set co.A is //-compact. 

3) By assertion 2) it suffices to consider the case of convex /i-compact sets. Assume for 
every neN the set A n is //-compact. Let us show that the set A = ® n eN^ n is //-compact 
in the topology of coordinatewise convergence. For an arbitrary compact set /C C A and 
for each n G N let /C n be the projection of /C onto A n . The set K. n consists of points 
x n G A n which are the corresponding coordinates of some point x G K.. This set is compact. 
Since the set A n is //-compact, it follows from Proposition [1] that for any e > there exists 
the corresponding compact /C™ C A n . Since /C C £g> neN /C n , we have JC £ = Cg> n eN /C £ ^_„ . 
It is easy to check that this set satisfies the assumptions of Proposition [TJ Therefore, the 
set A is //-compact. □ 

2 It is assumed that the set B possess all the properties mentioned in the beginning of Subsection 2.1. 
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The first assertion of Proposition H] implies that the intersection of /i-compact sets is 
/i-compact. However, their union or Minkowski sum is, in general, not /i-compact (Re- 
mark H|) . 

Remark 2. By the second assertion of Proposition H] to prove the /i-compactness of a 
convex set A it suffices to show the /i-compactness of any its subset B such that A = co B. 
Note that the sets of measures M(A) and M(B) (that are involved in the definition of 
/i-compactness of the sets A and B) can be completely different. For example, if A is a 
simplex, then B can be a countable family {e«} of isolated extreme points of the set A. 
Hence M(B) is isomorphic to the set ^+00 of all probability distributions with countable 
number of outcomes. The criterion of //-compactness for the set B, and therefore, for the 
set A, can be formulated as follows: for any compact set /C C A and for any e > there 
exists n such that the inclusion J2t=i ^i 6 * e ^ i 71 "*} e *-P+oo, implies ^% < £■ 

The second assertion of Proposition H] together with Proposition [5] below lead to the 
following observation. Let A be a /i-compact convex set in the initial topology r and let 
t' be a stronger topology on A, that coincides with r on the set extr^4; then the set A is 
/i-compact in the topology r' . 

Proposition [3] implies that all isomorphisms in the category of /i-compact convex sets are 
affine homeomorphisms. The affinity assumption cannot be omitted, which is seen from the 
following example. Suppose A is a convex set that is not /i-compact. The first assertion 
of Proposition H] and Corollary H] from the next subsection yield that the subset of the set 
M(A) that consists of Dirac (single-atomic) measures is a /i-compact set, which is, moreover, 
homeomorphic to the set A. This observation shows that the /i-compactness property, in 
contrast to the compactness, is not purely topological. It is defined by composition of the 
topology and of the structure of the operation of convex mixing. 

Proposition |3] gives the following condition of /i-compactness of families of maps. This 
condition is applied in the next section. 

Corollary 1. Let $(X,y) be a locally convex space with the topology r of maps from 
the set X to a locally convex space y. Let also $o be a convex closed bounded subset of the 
space $(X, y) that consists of maps taking values from the convex fi-compact set A C y. 
Moreover, 3o is a complete separable metric space, for which there is an element xo G X 
such that: 

1) {r-lim n ^ +00 $ n = $0} =>• {lim n ^ +oo $ n (x ) = $0(2:0) }, V{$„} C $ ; 

2) the set {$ G 5o I $(^0) G C} is relatively r-compact for any compact set C C A. 

Then the set Jo is ^-compact. 
Proof . The continuous affine map 

£ 3 $ ^ $(x ) G A 

satisfies the assumptions of Proposition El The first part of that proposition implies the 
/i-compactness of the set $o- d 
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For further analysis of the //-compactness we need a weaker version of this property. 

Definition 2. The set A is called pointwise fi-compact if for any x G co*4 the set M X (A) 
is a compact subset of the set M(A). 

Clearly, the pointwise //-compactness follows from the //-compactness. However, as we 
shall see in Proposition [T3l these two properties are not equivalent. 

//-compact sets do not possess many properties of compact sets, such as uniform conti- 
nuity and boundedness of continuous functions, the Weierstrass theorem of extremal values 
of continuous functions, and so on. It appears, however, that //-compact sets inherit some 
important properties of compact sets. This allows us to extend many results of the Choquet 
theory and of the Vesterstrom-O'Brien theory to those sets (see the next section). 

If .A is a convex set, then one can introduce the following partial order, called the Choquet 
order, on the set M(A) PQ,[H]. We suppose that // >- v if and only if 



for any function / G P{A). 

A measure // G M(A) is called maximal if v >- // implies v = // for any measure v G M(A). 
If // and v are measures from M(A) such that // y u, then b(/z) = b(z/). This follows from 
the fact that the set of continuous bounded affine functions on the set A separates its points. 
The following fact is a straightforward consequence of Definition [2J 

Lemma 1. Let A be a convex pointwise fi-compact set. Any subset of the set M(A) that 
is linearly ordered by the relation -< has the least upper bound. 

Proof . Any subset of the set M(A) linearly ordered by the relation -<, which is actually a 
net {//a}agA; is contained in M X (A) for some x G A and, consequently, is relatively compact. 
Whence there is a subnet {//A^Ken that converges to some measure /z G M X (A). One can 
easily verify that //a -< // for all A G A. 



Combining Lemma [T] with theorem 2.4 from [5] we see that the class of convex pointwise 
//-compact sets is a proper subclass of the class of convex sets with the Radon-Nicodim 
property. This class is studied in an extensive literature [HEJE]. 

Applying Lemma [T] and Zorn's lemma one can easily prove the following generalizations 
of the Krein-Milman theorem and of the Choquet theorem to pointwise //-compact sets. This 
actually follows from the Radon-Nicodim property of these sets [5|. 

Proposition 5. Let A be a pointwise fi-compact convex set. Then co(extr^4) = A and 
b(M(ixtr^A)) = A. 

Proof . Since the set of finitely supported measures is dense in M(extr^4) [THl theorem 6.3], 
we see that the first assertion follows from the second one. 

Let xq G A. Lemma Q] combined with Zorn's lemma yields the existence of the maximal 
measure //* in M xo . From the properties of the Choquet ordering it follows that the measure 




□ 
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/i* is also maximal in M(A)\ hence it lies in M (extr^4) (see the proof of theorem 5.2 in [1]). 
Thus, x G h(M (extrA)). 

□ 

Another property inherited by yU-compact sets from compact ones is the following repre- 
sentation of convex closure of lower semicontinuous functions [HI proposition 3]. Its proof is 
easily generalized to our class of sets. 

Proposition 6. If f is a lower semicontinuous lower bounded function on a convex 
^-compact set A, then its convex closure can be determined by the expression 

cof(x) = inf / f{y)n{dy), Va; G A, (3) 

where the infimum is attained at some measure /i£ from M X (A). 

This representation is a crucial point for most results on convex closures of functions 
defined on /i-compact sets. 

If / is a continuous bounded function on a convex /^-compact set A, then combining the 
continuity of the functional M(A) 3 /i 4 f A f(x)fi(dx) and [91 lemma 1] we see that the 
infimum in (J3]) can be taken over finitely-supported measures. 

Corollary 2. An arbitrary continuous bounded function f on a convex fi-compact set A 
possesses a lower semicontinuous (closed) convex hull, that is, 

cof(x) = inf S^TXif(xi) = cof(x), Wx G A. (4) 
{TVi,Xi}eMl(A) / — ' 

This is a /i-compact generalization of corollary 1.3.6 in [2J. The /i-compactness assumption 
about the set A in Proposition and in Corollary |2J cannot be weakened to pointwise 
/i-compactness. 

Proposition 7. If a convex set A is not ^-compact, but pointwise fi-compact, then there 
exists a continuous bounded function f on A, whose convex hull cof is not lower semicon- 
tinuous. This means that representation (TJ|) for the convex closure cof of the function f 
does not hold. 

Proof . Since the set A is not /^-compact, there exists a non-compact sequence of measures 
{Hn\ C M(A) such that the corresponding sequence {x n = b(/z n )} C A converges. By 
Prokhorov's theorem the sequence {fi n } is not tight. As it was shown in the proof of theo- 
rem 8.6.2 in [T7] this guarantees the existence of e > and 5 > such that for any compact 
set K C A and any natural iV there is n > N, for which n n {U${1C)) < 1 — e, where UsiJC) is 
a closed 5-neighborhood of the compact set /C. Since finitely supported measures is dense in 
the set of all measures with a fixed barycenter [HI lemma 1], applying corollary 8.2.9 from [T7] , 
we may assume that the sequence {/!„} contains only finitely supported measures. 

Let xo be a limit of the sequence {x n }. By the pointwise /^-compactness of the set A for 
the value e defined above there exists a convex compact set JC £ such that /i(/C £ ) > 1 — e/2 
for any measure /i G M X0 (A). 



S 



Let / be a bounded continuous function on A such that f(x) = 1 for all x £ K, e and 
fix) < for every x £ A\Us()C £ ). Then from the properties of the sequences {x n } and {/f n } 
it follows that for any natural N there is n > N, for which cof{x n ) < 1 — e. On the other 
hand, the properties of the set M X0 {A) imply that cof{x ) > 1 — e/2. Thus, the function 
cof is not lower semicontinuous. 

□ 

Remark 3. The pointwise /i-compactness condition cannot be omitted in the proof of 
Proposition [71 This shows that yU-compact sets do not form the maximal class of convex sets, 
for which Corollary [2] holds. However, without the pointwise /i-compactness Corollary [2] may 
fail (see Example [TJ in the next section). 

To construct an example showing that the pointwise //-compactness condition is essential 
in Proposition [7J we consider the unit ball B in a separable Hilbert space. Clearly, that is 
not a pointwise /i-compact set. Let us show that for any continuous bounded function f 
on B its convex hull cof is continuous. Since a bounded convex function is continuous at 
interior points of its domain, it suffices to prove the continuity of cof on the boundary of B, 
that is, on the unit sphere. 

Let x be a point of the unit sphere. For arbitrary e > there exists 5 > such that 
\f(x) — f(y)\ < e, whenever \\x — y\\ < 25 . Applying Lemma [2] stated below, we conclude 
that for any z such that \\z — x\\ < 5 and for any \x £ M Z {B) the measure of a ball of radius 
2 5 centered at x is at least r(5, z). Therefore, the value | fix) — f B fit) dfi | does no exceed 
er(5,z) + iV ( 1 — r(5,z)), where iV = sup teB Whence 

| f(x) - cof(z) | < er(5,z) + N (l - r(8,z)). 

Since for z — > x we have ||;z|| — >• 1 , it follows thatr(5, z) — > 1 and so cof(z) — > fix). It 
remains to note that cof(x) = fix), because x is an extreme point of B. 

Lemma 2. Let B be the unit ball of the Hilbert space and let 5 > 0. For an arbitrary 
point z £ B such that \z\ > 1 — 5 and for any measure \i £ M z iB) the measure of a ball 
of radius 5 centered at z is at least r{5, z) — — zl^zMLl 



8 2 - (l-II^H) 2 



Proof. Let z = -rr» and 



1 + |U||2 £2^| r 1+ II ||2_f2 

B = lyeB, iy,z) < L" „ , B 1 = y £ B, iy,z) > 



2\\z\\ J ' 1 ' w ' ' ~ 2\\z\\ 

By a direct calculation we show that if ||y|| = 1 and \y— z\ > 5, then y £ B . Consequently, 
all points of the ball B lying at a distance more than 5 from the point z are located in the 
set Bq. Denote by q the barycenter of the measure /i on the set Bi , i = 0,1. We have 
z = /i(B ) c + /t(Bi) c\. It is obvious that (co, z) < ^-feLp and (ci,z) < 1. Therefore, 

\\4 = (z, z) < (1 - 1 + ^ + 

which gives the desired inequality for the measure of Bi, and hence for the measure of the 
ball of radius 5 centered at z, since this ball contains B\. 
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□ 



One of the most important conclusions from Proposition [6] is that any lower semicontinu- 
ous lower bounded function / defined on a convex /i-compact set A coincides with its convex 
closure cof on the set of extreme points extr^4. Furthermore, that proposition enables us 
to obtain the following representation for the set extr^4, which will help us in Section 3. 

Proposition 8. Let A be a ^-compact convex set. Then 

extr.4. = O Bf, where Bf = {x E A \ f(x) = cof(x)}. (5) 
feQ{A) 

Proof. The inclusion extr.4 C Bf for any function / E Q(A) follows from (@|. Suppose 
x E A\extr A; then there are two distinct points x\ and x 2 in A such that x = |xi + \x 2 - 
To prove that x is not in ClfeQCA) one nee ds to find a function / from Q(A) such that 
f(xo) > \f(x\) + \f(x2). The function — a 2 (-) will do, where a is an afline continuous 
bounded function on A such that a{x\) ^ a{x<i). □ 

Example [1] in the next subsection shows the importance of the /i-compactness assumption 
in Proposition [HJ 

Arguing as in the proof of Proposition [7] one can easily produce the following necessary 
condition for representation (jHJ). This is a condition of local /i-compactness in neighborhood 
of the set extr*4: for any extreme point xq of the set A and for any sequence {x n } C A 
converging to Xq the set b _1 ({x n }) is compact in M(A). 

2.2 Examples 

Any compact set is obviously /i-compact. In this section we consider the several most 
important examples of /i-compact, but not compact sets. 

Proposition 9. The bounded par% of the positive cone in the space l\ is [i-compact. 

Proof. It is sufficient to take the family of functions of the form l\ 3 {xi} (-> hiXi, where 
{hi} is an increasing unbounded sequence of positive numbers, and then apply Proposition [2] 
taking into account the compactness criterion for subsets of the space l\. □ 

Corollary 3. The set ^)3+oo of all probability distributions with countably many outcomes 
is a ^-compact subset of the space l\. 

Remark 4. Let = {x & l\ \ x > , \\x\\i < 1 }. Proposition [9] implies that the 
sets A\ and — A\ are both /i-compact in the metric l\. However, neither their convex hull 
nor their Minkowski sum is /i-compact. They are actually not even pointwise /i-compact, 
because they contain a unit ball of the space l±, which is not pointwise /i-compact (this is 
easy to show). 

3 Here and in what follows by the bounded part of a positive cone in an ordered Banach space we mean 
the intersection of this cone with a unit ball. 
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Proposition 10. An arbitrary weakly closed bounded (in variation) set of Borel measures 
on a complete separable metric space is ^.-compact in the weak convergence topology. 

Proof . Let X be a complete separable metric space, M be a weakly closed bounded set of 
Borel measures on that space X, %3(X) be the set of all lower semicontinuous functions tp 
on X taking values from [0, +00] such that the set {x G X \ ip(x) < c} is compact for all 
c > 0. Prokhorov's theorem (see [T7], example 8.6.5, p. 236) implies that the set M C M 
is relatively compact if and only if there exists a function tp G QJ(Jf), for which 

sup / (p(x) fi(dx) < +00 . 
tieMo J x 

Hence the family of affine lower semicontinuous functions f v (fi) = J x <p(x)/j l (dx), (p G 03(A) 
on the set M satisfies all the assumptions of Proposition [2J □ 

Corollary 4. The set of all Borel probability measures on a complete separable metric 
space is fi-compact in the topology of weak convergence. 

Using Propositions [3] and [9] as well as Proposition [15] stated below one can prove the 
following assertion on the properties of the cone of positive operators in the Shatten class of 
order p, that is, in the Banach space of all operators acting in a separable Hilbert space H 
such that Tr\A\ p < +00 with the norm \\A\\ P = (Tr \A\ P ) 1/p . 

Proposition 11. The bounded part of the positive cone in the Shatten class of order p 
is fi-compact precisely for p — 1. 

Proof . In the case p = 1 by applying the compactness criterion for subsets of the positive 
cone % + (H) of the space of trace class operators T("H) ([2Tj. Appendix), we obtain that 
the map taking an operator A G to the sequence of its diagonal elements (in some 

fixed basis of the space %) satisfies the assumptions of the first part of Proposition [3] (with 
the bounded parts of the positive cones of the spaces %(H) and h in the roles of A and B 
respectively). Combining that proposition with Proposition [9] we obtain the /i-compactness 
of the bounded part of the cone T + ("H). 

The cone of positive operators in the Shatten class of order p > 1 contains a subcone of 
commuting operators. That subcone is affinely homeomorphic to A p (the bounded part of 
the positive cone in the space l p ), which is not /i-compact (Proposition [15]). □ 

Proposition [11] yields, in particular, the /i-compactness of the set &(H) of quantum states 
- density operators in a separable Hilbert space H. This fact was originally proved in [22 J. 
Corollary [T] and Lemma [5] from Appendix imply the following result. 

Proposition 12. Let 2, + {'H : 'H l ) be the cone of positive linear continuous maps from the 
Banach space T('H) of trace class operators in a separable Hilbert space TL into a similar 
space %{%'). Then the bounded (in the operator norm) part of this cone is fi-compact in the 
strong operator topology. 

Proposition [12] implies /i-compactness of the sets of quantum operations and of quantum 
channels in the topology of strong convergence |21j . 
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Proposition [12] also yields the /i-compactness (in the strong operator topology) of the 
bounded part of the cone of linear continuous positive operators in Indeed, this cone is 
naturally identified with a subset of the cone This shows the /i-compactness of 

the set of sub-Markov operators, in particular, Markov operators. 

Now consider some "negative" examples. Proposition [T3] gives an example of pointwise 
/i-compact sets (Definition [2]) that are not /i-compact. We are going to see that in Hilbert 
space there are no /i-compact sets that are not compact (Proposition [T4"l) . Then we give 
several examples of sets that are not even pointwise /i-compact. 

By definition the pointwise /i-compactness property of a set survives weakening the topol- 
ogy. The next proposition shows that /i-compactness does not possess this property. The 
bounded part of the positive cone in li loses the /z-compactness after weakening the topology. 

Proposition 13. For any p > 1 the simplex A p = { x G l p | x > 0, Y2t=i x, 1 < 1^ in 
the space l p is pointwise ^-compact, but not [i-compact. 

Proof . The pointwise /i-compactness of the set A p follows from the remark above. Let us 
show that A p is not /i-compact in the space l p . Consider an increasing sequence of natural 
numbers {n r } rgN and a sequence of nonnegative numbers {zi}^ such that XT^n 1 " 1 z % = 1 

and Etn' 1 ^ i for each r > 1. The set £ = {y e A„ | Vr G N £tn r (V) p < 7} 
is compact. If the set A p is /i-compact, then by Proposition [1] for any e > there is the 
corresponding compact set IC e . The set K £ can contain only a finite number of vectors of 
the canonical basis {e^}, otherwise it is not compact. Let N be such that ej ^ IC e for 
i > N. Take an arbitrary r for which n r > N and denote by x G A p the vector with 
coordinates x l = z l for n r < i < n r+1 and x % = for all other i. Clearly, x G K. Since 

X = X]r=n 1_1 X ' 1 e i all d Sr=n 1_lx * = 1> e i £ ^£ ^ OT aU * = n r, n r+l — 1, we COme to the 

contradiction with the /i-compactness criterion from Proposition [TJ 

□ 

In particular, Proposition [T2] shows that a Hilbert space contains noncompact pointwise 
/i-compact sets. It appears that it does not contain /i-compact sets that are not compact. 

Proposition 14. There are no ^-compact subsets of Hilbert space that are not compact. 

Proof. We describe the idea of the proof omitting details, which can be easily reconstructed 
by the reader. Let A be a bounded convex closed subset of a Hilbert space. Without loss of 
generality it can be assumed that its diameter is 1. If A is not compact, then there exists 
a sequence of its elements {afe}fc £ N such that all their norms and all pairwise distances 
between them exceed some value e > 0. Because of the weak compactness of A it can be 
assumed, after possible passing to a subsequence, that the sequence {a^} converges weakly 
to some element a. Since the set A is convex and closed, we have a G A . The sequence 
{bk = at — ajfceN converges weakly to zero. Hence by passing to subsequences one can 
achieve a fast convergence to zero for the scalar products: (bi,bj) < e 2 2~ 1 ~ : > for every 
i 7^ j. Since e < ||&i||2 ^ 1 for all i G N, invoking the Cauchy-Schwarz inequality we 
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conclude that any sequence x G Z 2 satisfies the inequalities 



2IMI2 ^ \\J2 xibi 

i 

This means that the system of elements possesses the Riesz basis property. Then there 
is a continuous linear operator that is continuously invertible and taking the system { bk } 
to an orthonormal one [23J. This operator maps the convex hull of points a and { at } ken 
to the set A 2 from Proposition [131 which is not /i-compact. Hence, this convex hull is not 
/i-compact, therefore nor is the set A. 

□ 

Let us now consider two important examples of not pointwise //-compact sets. 

Proposition 15. For every p > 1 the set A p = { x G l p \ x > 0, ||a;||p < l} (the 
bounded part of the positive cone in the space l p ) is not pointwise ^-compact. 

Proof. Let us show that if a point x G A p is such that \\x\\ p < | and Ylii x i = +°°> then 
it has no compact set fC £ for e = ~ (see Proposition [1]). If such a compact set exists, then 
it can contain only finitely many elements of the canonical basis {e{\. Take a sufficiently 
large N such that e, ^ K e for every i > N. Since the series J^X; diverges, we see that 

there exists r, for which s = J2i=N+i xl e (I'D - x = x — Y^iJn+i x1 e * (^ ne en tries 
of the vector x from the (N + l)st to the (N + r)th are zeros, and the others coincide with 
the corresponding entries of x). Then x = (1 — s) (jz~x) + J2i=N+i x%e i- Since j^- < 3 
and \\x\\ p < |, it follows that jr^x G A p . All the points in this barycentric combination 
lie outside of /Q, but their total weight s exceeds |, which is a contradiction. □ 

The next example complements Proposition [7] and demonstrates that not pointwise 
/i-compact sets do not have to satisfy relations and (@J for continuous bounded con- 
cave functions. This violates representation (EJ). 

Example 1. Let / be a continuous function on the bounded part A p of the positive 
cone of the space l p for p > 1 that takes the value 1 at zero and vanishes at all the vectors 
of the canonical basis {e n } of the space l p . For example, the function /(■) = 1 — || • || p . Since 
the zero vector of the space l p is a limit point of the set of all convex combinations of the 
vectors {e n }, the convex closure of the function / is an identical zero on the set A p . Therefore, 
co/(0) 7^ /(0). This example shows also that for the set A p such that A p = co(extr^4 p ) and 
map (j2J) is open (this follows from a theorem in [15] combined with the strict convexity of 
the space l p for p > 1 and with the proof of theorem 1 in [9]) the assertion of corollary 2 
in [9] does not hold, that is, a continuous function on the closed set extr^ need not have 
a convex continuous (or even lower semicontinuous) extension to A p . 

A Hilbert cube is the set H a = {x G I2 \ \x l \ < a 1 , i 6 N}, where a = { a 1 }^ is 
an arbitrary sequence of positive numbers. Let us show that the following alternative holds 
for any Hilbert cube. 

Proposition 16. If || a U2 < +00, then the set T-L a is compact; otherwise, if \\ a H2 = +00, 
then it is not even pointwise ^.-compact. 



< 2 \\x 

2 
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Proof. The first assertion is well known. It follows, for instance, from the compactness 
criterion for l 2 . If || a || 2 = +00, then we split the sequence a into blocks so that each block 
contains finitely many consecutive elements the sum of whose squares exceeds 1. Suppose 
that the n-th block consists of elements a k , a k+1 , . . . , a k+m . We write b n = Yli^iT a% e % 
for every n and denote by C the closure of the linear span of the elements b n , n G N. The 
set C is a Hilbert space with orthogonal basis {b n }. The unit ball of the space C is contained 
in H a . Since a ball in a Hilbert space is not pointwise /i-compact, it follows that the set H a 
is not so either. 

□ 



3 The CE-properties of /i-compact convex sets 

In the 1970s various properties of convex compact sets, in particular, the continuity properties 
of the convex hulls of continuous functions have been intensively studied. Vesterstrom proved 
in JTU] the relation between continuity of the convex hull0 of arbitrary continuous function 
and the openness of the barycenter map. He also conjectured the equivalence between conti- 
nuity of the convex hull of any continuous concave function (called the CE-property in |llj ) 
and the continuity of the convex hull of any continuous function (called the strong CE-prop- 
erty in [9]). This conjecture was approved by O'Brien [12], who showed the equivalence of 
these properties to the openness of the convex mixture map (x, y, A) 1— > Xx + (1 — \)y. In 
the subsequent papers the latter property was studied for convex sets that are not necessar- 
ily compact, and was called the stability property. Convex sets having this property were 
called stable convex sets [13]. The relations between the stability property and several other 
properties of convex sets were also revealed [14]. [T5]. 

In this section we generalize the Vesterstrom-O'Brien theory to the class of /i-compact 
convex sets. The first partial result in this direction was obtained in [9J, where the /i-com- 
pact version of theorem 3.1 in [10] was proved. The following theorem is the /i-compact 
generalization of the main result in [12]. 

Theorem 1. For a convex fi-compact set A the following properties are equivalent: 

x ~\~ y 

(i) the map A x A 3 {x,y) — - — £ A is open (the stability property); 

(ii) the map M(A) 3 \i t-> b(/i) E A is open; 

(iii) the map M (extr.4) 3 [i 1— > b(/i) G A is openj^ 

(iv) the convex hull of an arbitrary function in C(A) is continuous (the strong CE-property); 

(v) the convex hull of an arbitrary function in Q(A) is continuous (the CE-property). 

4 By corollary 1.3.6 in [5] the convex hull of any continuous function on a compact set coincides with the 
convex closure of this function. 

5 This map is surjective by Proposition [5] 
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Equivalent properties (i) — (v) imply the closedness of the set extr„4. 

Remark 5. Property (i) in Theorem [T] is equivalent to the openness of the map 
A x A x [0,1] 3 (x,y,X) n- Ax + (1 - X)y G A [H]. Properties (iv) and (v) in 
Theorem [I] can be formulated as the continuity of the convex closure and its coincidence 
with the convex hull for any function in C(A) and in Q(A) respectively 

Remark 6. If properties (i) — (v) hold for /i-compact set A, then the family F(A) in 
Proposition [2] can be chosen consisting of lower semicontinuous functions. Indeed, by using 
property (ii) it is easy to show that the functions f v constructed in the proof of Proposition [2] 
are lower semicontinuous. 

The proof of Theorem [Tj. Note first that (v) implies the closedness of the set extr*4 by 
Proposition [HI since (v) guarantees the closedness of the set £>/ = {x G A \ f(x) = cof(x)} 
for any function / G Q(A). 

(v) =>- (iii) The proof of this part of theorem (as well as the proof of the analogous part 
of theorem 3.2 in [TO]) can be realized by means of lemma 2.1 in [TO]. That lemma can be 
proved without the compactness assumption by the following observation: if X is a compact 
space and Y is an arbitrary topological space then the image of any closed subset of X x Y 
under the canonical projection X x Y 3 (x,y) i— >■ y G Y is a closed subset of Y. 

By representation flH]) the convex closure of any function / in Q(A) is determined by the 
expression 



cof(x) = inf /•*(/), Vx G A, where /i(f) = / f(x)fi(dx). 

Hence (v) yields the continuity and boundedness of the function 

A3 x ^ sup{//(/) | /i G M(extr „4), = x} 

for any function / in P{A). The above-mentioned generalization of lemma 2.1 in [TU] with 
K = M(A), M = M(extr^4) and K' = A implies the openness of the map 

M(extrA) 3 ii H> b(/i) G A, (6) 

provided the set M(extr^4) is endowed with the topology which has the prebase consisting 
of the sets {// G M(extr A) \ //(/) > 0}, / G P(A). Following the terminology in [10] . 
this topology will be called the p-topology. This is the weakest topology providing lower 
semicontinuity of the functionals /i //(/) for any function / G P(A). 

By using Lemma O (see Appendix) we will show that the openness of map in the 
p-topology on M(extr v 4) and the closedness of the set extr.4 proved above imply the open- 
ness of map 06]) in the weak topology on M(extr .4.) J§ To realize this it suffices to show that for 
an arbitrary converging sequence {x n } C A and for an arbitrary net {fi\}\eA C M(extr.A) 
such that 

Hi/^jAeA) Q {%n} and 3p-lim/i A = /x , 

A 



6 In the case of compact set A the coincidence of these topologies on M(extr.4) is proved in [TU] (lemma 
3.4). In the case of /i-compact set A we can not prove this coincidence. 
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where /io is a measure in M(extr^4) such that b(/i ) = lim n -s>+oo ^n, there exists a subnet of 
the net {/^a}a£A that converges weakly to the measure /i . 

Let {x n } and {^\}\e\ be the above sequence and net, respectively. Since the sequence is 
relatively compact, /i-compactness of the set A and the inclusion b({/i A } Ae A) ^ {x n } imply 
relative compactness of the net {/iaIaga in the weak topology and hence the existence of the 
subnet {^\ n }ir£n weakly converging to a some measure v G M(extr^4). By the definitions of 
the weak topology and of the p-topology we have 

u(f) = lim/iU/) > p-liminf /i A (/) > /i (/), V/ G P(^). 

7T A 

This means that v y /io (in the Choquet ordering). Closedness of the set extr^l implies the 
maximality in M(A) of any measure in M(extr^4). This can be proved by using Theorem 2.2 
in [5] and the arguments from the proof of Theorem 1.1 in [TJ, but it can also be immediately 
shown by using property (v) and coincidence of any function in Q(A) with its convex hull 
on the set extr^4. Thus /io is the maximal measure in M(A) and hence v = fiQ. 

(iii) (i) This implication follows from Proposition [5] and Proposition [T7J below (with 
X = extiv4). 

By Remark the equivalence of properties (i), (ii) and (iv) for convex /i-compact subsets 
of a Banach space is proved in [21 theorem 1]. That proof is easily extended to the class of 
sets considered in this paper. 

The implication (iv) =^> (v) is obvious. 

□ 

In the proof of Theorem [T] we have involved the following result of the measure theory 
( [231 theorem 2.4]). 

Proposition 17. Let X be a complete separable metric space. The map 

M{X) x M{X) 3 (/i, v) ^ -(/i + v) G M{X) 

is open. 

Since the set M(X) is /i-compact (Corollary HJ), we arrive at the following observation. 

Corollary 5. Properties (i) — (v) in TheoremUl hold for the set of Borel probability 
measures on a complete separable metric space endowed with the weak convergence topology. 

The /i-compactness condition is essential in the proof of Theorem (TJ it can not be removed 
without changing the whole structure of the proof. This motivates the conjecture that the 
class of /i-compact convex sets is the maximal class of convex metrizable sets for which the 
Vesterstrom - O'Brien theory can be generalized. This conjecture can be justified by the 
following example, showing that even pointwise /i-compactness is not sufficient for the proof 
of Theorem [U 

Proposition 18. For any p > 1 the pointwise [i-compact simplex 

+ 0O 

A p = {x el p | x > o , J]V < 1} 

i=l 
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in l p is stable, that is, it possesses property (i) in Theorem\]\ which implies (ii), but it does 
not possess properties (iii) — (v) . 

Note that for p = 1 the /i-compact simplex Ai = Ai has properties (i) — (v) in Theorem[TJ 

Proof . Example CD shows that the simplex A p does not possess properties (iv) and (v). Let 
us show that it does not possess (iii) either. Note that extr A p = { , , i G N } and that 
the set A p is a real simplex: for any its point x there exists the unique measure on extr A p 
with the barycenter x. The sequence of points x n = (-,•■■ -,0 ,-■ •) G A p (the first n 
coordinates equal to the all others are zeros) converges to zero in l p as n — » +00, but it 
is easy to see that the corresponding sequence of measures on extr A p does not converge to 
the single atom measure supported at the point 0. 

Let us now show that for an arbitrary p > 1 the set A p is stable, that is, it has 
property (i), which implies (ii) (see the proof of theorem 1 in [9]). It suffices to prove that 
for arbitrary points a, b C A p , c = ^(a + 6) and for arbitrary e > , there exists 
5 > with the following property: for any z G A p such that || z — c\\ p < 5 there exists 
a segment [x,y] C A p centered at z, for which || x — a \\ p < e and || y — b \\ p < e. By 
taking sufficiently small e it can be assumed that || a \\ p < 1 — e and that || b \\ p < 1 — e. 
Otherwise the points a and b can be replaced by sufficiently close points belonging to the 
interior of [a , b]. Since the / p -norm is strictly convex, the norms of a and of b become less 
then 1. Then we choose a large N so that for each of the points a and b the norm of the 
"tail" from the (N + l)th coordinate is less than ~e, that is, (Ylt=N+i ( a ' k ) p ) 1 P < \ £ an d 
(I2k=N+i (b k ) p ) < \s . Consider the space M. N , generated by the first iV coordinates. 
Denote by A p and s the restrictions of the set A p and of arbitrary element s G l p to this 
space. Since A p is a simplex in M. N it is stable (see [13]) and hence one can take 5 > 
such that there exist points x , y G A p , for which | (x + y) = z , || x, — a \\ p < |s and 
|| y — b ||p < I e , if || z — c ||p < 5. Now for given z G A p and for arbitrary t G [—1, 1] we 
define the points x(t), y(t) G l p as follows: 

k (A f x k , k < N k j y k , k < N 

X { ) ~ \ (l+t)z k , k > N V { ) ~ \ (l-t)z k , k > N 

By construction | (x(t) + y{t) ) = z for any t, while the norms of the elements x(t) and 
y{i) do not exceed 1 — |e + 2 5. Indeed, 

n 12 

5 < a + \\x —a>\\ < 1 — e + -e = 1 — -e, 

II Wp — II lip II lip — 3 3 

while the norm of the "tail" of (1 + 1) z does not exceed the sum of norms of the "tails" 
of 2c and 2(z — c), that is, it does not exceed 2 (|£ + 5). Taking the sum we obtain 
|| x{t) || < 1 — i e + 2 5, and the same is true for y{t). For 5 < |e we get || x{t) || p < 1 

and || y(t) || < 1 . Let us show that there exists r G [—1, 1], for which || x (r) ||i < 1 and 
|||/(t)||i < 1, and whence x(r),y(r) G A p . It is clear that ||£||i < 1 and ||y||i < 1. 
For the sake of being defined, suppose || x ||i > || y ||i. If || y(— 1) ||i < 1, then one can take 
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t = —1, since || x(— 1) ||i = \\x\\i < 1. If \\y(— 1) ||i > 1, then \\y(— 1) ||i > \\x(— 1) ||i, 
and since || y(l) ||i < || x(l)||i, applying the continuity argument, we conclude that there 
is r G [—1,1] such that ||f/(r)||i = ||x(r)||i. Since | (x(t) + y(r) ) = z, we have 

II X ( T ) Hi = II Z/( r ) Hi = II z Hi < !■ 

Finally, the norm of the difference || x(r) — a\\ p does not exceed |e for the first A" 

coordinates, while for the other coordinates it does not exceed the maximal norm of the two 

"tails": of the element a and of 2z. Hence, 



||^(t) - a\\ p < + maxj^U, 2^e + = +25. 

For 5 < | e we obtain \\x(r) — a \\ p < e, and similarly \\y(r) — b \\ p < e. By setting 
x = x{t) , y = y(r), we complete the proof. 

□ 



4 Applications to quantum information theory 

An important example of convex /i-compact sets, for which the equivalent properties of 
Theorem [1] hold, is the set ©("H) of quantum states|3 The quantum states are density 
operators (positive operators with trace equal to 1) in a separable Hilbert space "H |27J. 
The set of extreme points of the set ©(H) consists of one-dimensional projectors called pure 
states. The //-compactness and the stability property (i) in Theorem CD of the set ©(%) are 
established in [221 proposition 2] and in (25j lemma 3] respectively. These properties are used 
essentially in the study of characteristics of quantum states and of quantum channels. For 
instance, //-compactness of the set &{T-L) makes it possible to prove that any nonentangled 
state (see below) of composite quantum system can be represented as an average (barycenter) 
state of some generalized ensemble of pure product states (probability measure on the set 
of product pure states) [26]. The stability property of the set 6("H) plays the crucial role 
in the proof of the lower semicontinuity property of the x-function of an arbitrary quantum 
channel, which is an important characteristic related to the classical capacity of this channel 
[25]. 

In this section we consider a result following directly from the generalized Vesterstrom- 
O'Brien theorem (Theorem 1) applied to the stable set 

According to the quantum mechanical formalism, states of composite quantum system, 
arising as a result of joining two quantum systems represented by two Hilbert spaces % and 
/C, correspond to the density operators in the tensor product % <S> IC of these spaces. A 
specific property of the quantum mechanical statistical model (in comparison to the classical 
one) is the existence of the so called entangled states of composite system, which can not be 
represented as convex combinations of product states describing independent subsystems. 
Entanglement can be considered as a special purely quantum correlation, which is the base 
for the construction of different quantum algorithms, quantum criptographical protocols and 

7 The set G(H) is compact if and only if dim H < +oo. 
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systems of information transmissions, which attract a lot of attention of scientists in the last 
two decades (see [27], chapter 3). That is why the study of the entanglement, in particular, 
of its quantitative characteristics, is one of the main problems of the quantum information 
theory. 

Let H and /C be separable Hilbert spaces. A state u G &(H <S> JC) is called nonentangled 
if it belongs to the convex closure of the set of product states, that is, of states of the form 
p® a, where p G &(H) and a G <5(/C); otherwise it is called entangled. 

Entanglement monotone is an arbitrary function E on the set (5("H £g> /C) that possesses 
the following properties (see [25]. [2"9]): 

E-l) {E(cu) = 0} <^ {the state u is nonentangled}; 

E-2) Monotonicity under Local Operations and Classical Communications (LOCC), which 
means 



for arbitrary state u> G ©("H ® K.) and arbitrary LOCC-operation, transforming the state u 
into the set [uji] of states with the probability distribution {7Tj} (see details in [29|). 
E-3) Convexity of the function E on the set &{H® K), which means 



for arbitrary finite set {uji} of states in ® /C) and probability distribution {vrj}. 

The standard method of "generation" of entanglement monotones (EM) in the case of 
finite dimensional spaces H and K, is the convex roof construction (see [29j,[30j). In accor- 
dance with this method, for an arbitrary concave continuous nonnegative function / on the 
set &(H) such that 



for any state p in ©("H) and any unitary operator U in the space % the corresponding EM 
E* is defined by 



where : u t— > Tr^w is the partial trace [27] (by the spectral theorem the right hand side of 
OH]) is well defined). If the von Neumann entropy H(p) = — Trplogp is used as a function /, 
then this method provides the construction of the Entanglement of Formation, which is one 
of the most useful entanglement measured [29] . 

In what follows the properties of the function E* defined by (Q in case of infinite dimen- 
sional spaces H and K are considered. 

An important problem in constructing of EM is to analyse the continuity properties, in 
particular, to prove its continuity on the entire state space &(T-L <8> K) (formally the last 

8 Entanglement measure is a EM having the particular additional properties 291. 




(7) 




r 1 (0)=extr6(^) and f(p) = f(UpU*) 



(8) 




(9) 
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property is not included in the definition of EM, but in finite dimensions it is considered 
as a natural requirement). Note that the continuity of the function E* is not obvious even 
in the finite dimensional case and in general it is proved by using the explicit form of the 
function /. By Theorem [T] the /i-compactness and stability of the set &(H ® JC) guarantee 
continuity of the function E$ on this set for an arbitrary continuous function / in the both 
finite and infinite dimensional cases. 

Theorem 2. Let f be a concave continuous nonnegative function on the set &(T-L) satis- 
fying condition Then the function E$ defined by (0|) is an entanglement monotone that 
is continuous on the set &{T-L® K). 

Proof . Nonnegativity, concavity, and continuity of the function / imply its boundedness. 
By Theorem[T]the stability property of the /x-compact set &{1-L®1C) guarantees the continuity 
of the function co(/ o 0) and therefore, its coincidence with the function co(/ o G), which 
by Proposition E] has the following representation 



where the infimum is achieved at some particular measure /x w in M u (&('H<Si)C)). By concav- 
ity, continuity, and boundedness of the function / o G one can assume that fi^ is a measure 
in M w (extr 6 (H<S>fC)). Hence the definition of the function E* and concavity of the function 
/ o Q imply E-f = co(f o 6) = co(/ o 6). 

By (jSJ) the nonnegative function / o G vanishes on a pure state in &(%® JC) if and only 
if this state is product. As shown in [2B], a state u is nonentangled if and only if there exists 
such measure fi w supported by pure product states that bf^) = oj. Thus the above remark 
shows that condition E-l is fulfilled for the function Jv = co(/ o 0). 

Condition E-2 for the function E* is established in the same way as in the finite dimen- 
sional case (see [29]). 

Condition E-3 for the function E? follows from its definition. 



Example 2. Generalizing the observation in [30] to the infinite dimensional case, con- 
sider the family of continuous concave functions 



on the set &{H) with dim'H < +oo. It is easy to see that all the functions in this family 
satisfy assumptions jSJ). By Theorem [2] {E^ a } a> i is a family of entanglement monotones, 
which are continuous and bounded on the set with dim'H < +oo and dim/C < +oo. 

The case a = 2 is of special interest since the entanglement monotone E^ 2 can be considered 
as an infinite dimensional generalization of the notion of I-tangle [3Tj . 

5 Possible generalizations and open questions 

Proposition[T]actually gives an equivalent definition of the /i-compactness property for convex 
sets of the class considered in this paper. A convex set A is /i-compact if and only if for 





(10) 



□ 



/ Q (p) = 2(l-Trp a ), a>l, 
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arbitrary compact set K, C A and for arbitrary e > there exists a compact set IC e A 
such that for any expansion of a point x G /C into convex combination of points in A 
the total weight of points belonging to the set JC £ is not less than 1 — e. This property of 
(arbitrary!) convex set can be called generalized /i-compactness, or, in short, /i-compactness. 
By Proposition [T] the /i-compactness property means /i-compactness for convex bounded 
subsets of locally convex spaces, that are complete separable metric spaces. The above 
definition of /i-compactness is translated without any change to any convex closed subsets 
of linear topological spaces, not necessarily bounded. The definition of /i-compactness is, in 
contrast, not generalized to unbounded sets, since for unbounded sets the barycenter map 
may not be well defined: the integral b(/t) = x fi(dx) may not exist for some measures 
/a G M(A). Thus the notion of /i-compactness generalizes the notion of /i-compactness to 
a wider class of convex sets. Similar to the case of /i-compact sets, the intersection and the 
Cartesian product of finite or countable family of /i-compact sets is /i-compact, the convex 
closed subset of a /i-compact set is /i-compact. The proof of this assertions is literally 
the same as the proof of Proposition HI A complete analog of Proposition [3J for continuous 
transformations of /i-compact sets holds as well. Nontrivial examples of /i-compacts sets 
appear even in the finite dimensional case. 

Lemma 3. An arbitrary convex closed pointed (not containing any line) cone in M d is 
ft- compact. 

Proof . Let C C M. d be a convex pointed cone. Hence there exists a vector a G M. d such 
that inf fa;, a) > [3"2"| p. 53]. Then for each r > the truncated cone 

xaC jIIx'H = 1 

C r = { x G C , (x, a) < r} 

is compact. Arbitrary compact set K, C C can be embedded into a particular truncated 
cone C T . Then for each e > the compact set JC e = Cz has the required property. 

□ 

The following result from the convex geometry is well known, so we omit its proof. 
Lemma 4. The following properties of a convex closed set A C M d are equivalent: 

(i) A is contained in a convex pointed cone; 

(ii) A has at least one extreme point; 

(iii) A does not contain a straight line; 

(iv) the polar of the set A has a nonempty interior. 

By applying Lemma [3] we conclude that property (i) implies /i-compactness of the set 
A. On the other hand, a line is not /i-compact, hence /i-compactness implies property (iii). 
Thus, we obtain the following result. 

Proposition 19. In the space M. d the jl- compactness is equivalent to each of properties 
(i) — (iv) in Lemma\4\ 
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Positive cones in the spaces l p and L P (X) are /i-compact in the weak topology. The 
proof is analogous to the proof of Lemma [3] and is based on the weak compactness of bounded 
sets in this spaces. The positive cone in li (Proposition [9]), the cone of finite Borel measures 
on a complete separable metric space (Proposition [TU1) . and the cone of positive operators 
in the Shatten class of order p = 1 (Proposition [TTT) are /i-compact and, in contrast to 
these propositions, one need not take bounded parts of these cones. Thus, /i-compactness 
substantially extends the notion of //-compactness. This motivates our first question. 

Question 1. To what extent are the results of this paper generalized to jl-compact sets ? 

The following questions concern /i-compact sets. 

Question 2. Do there exist ^-compact noncompact sets in the spaces L p and l p with p > 1 ? 

Question 3. Consider a Banach lattice. Under what conditions is the bounded part of the 
positive cone in it fi-compact ? 

Question 4. Under what conditions on a convex set A, is the convex hull of an arbitrary 
continuous bounded function on this set continuous ? 

The latter property holds for stable //-compact sets (Theorem [T]), but it does not hold 
for stable pointwise /i-compact sets that are not /i-compact (Proposition [7]). The unit ball 
in the space l 2 possesses this property (Remark [3]), but the positive part of this ball does 
not (Example [T]). 

6 Appendix 

6.1 The compactness criterion for subsets of the cone £+(%,%') 

Let £+("H, %') be the cone of linear continuous positive maps from the Banach space %(%) of 
trace-class operators in a separable Hilbert space H into the similar Banach space T('H / ). The 
compactness criterion for subsets of this cone in the strong operator topology is presented 
in the following lemma. 

Lemma 5. 1) A closed bounded subset £ C £ + (%, "H') is compact in the strong operator 
topology if in &(T-L) there exists such full rank state a that {$(o")}$ e £ is a compact subset 
of 'l('H'). 

2) If a subset £ C £+(%, W) is compact in the strong operator topology then {$(<r)}$ e £ 
is a compact subset of%{H') for any state a in &(%). 

Proof. 1) Let {\i)} be the basis of eigenvectors of the state a arranged in nonincreasing 
order and T-L m be the eigen subspace generated by the first m vectors of this basis. 
Let be an arbitrary sequence of maps in £q. 

Show that for each m for an arbitrary operator A in %(H m ) there exists such subsequence 
{<3> nfc } that the sequence {Q nk (A)}k converges in T(H'). Suppose first that A > 0. Since 
A G c X(H m ) there exists such A a > that XaA < a. By the compactness criterion for subsets 
of T('H / ) (see the Appendix in [21]) for arbitrary e > there exists finite rank projector 
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P £ G <B(H') such that Tr(I w - P £ )$(a) < e, and hence Tr(I w - P e )$(A) < X^e for all 
$ G £o- By the same compactness criterion the set {<I>(v4)}$ g £ is compact. This implies 
existence of the desired subsequence for a positive operator A. Existence of such subsequence 
for an arbitrary operator A G T('H m ) follows from representation of this operator as a linear 
combination of positive operators in %(H m ). 

Thus for each m an arbitrary sequence {$ n } C £o contains such subsequence {&n k } that 
there exists 

\unJ nk {\i){j\) = C% (11) 

for all i,j = l,m, where {C™} are particular operators in %{%'). 

For arbitrary m' > m, by applying the above observation to the sequence {<3> nfc }fc, we 
obtain such subsequence of the sequence {$ n } that ffTTj) holds for all i,j = l,m' with such 
set of operators {Q™'}, that C^' = for all i,j = l,m. 

By using this construction one can show existence of the set {Cij}f °Zi °f operators having 
the following property: for each m there exists such subsequence {$ nfc } of the sequence 
that (HU) holds with C% = Cy for all i, j = T~m. 

Consider the map defined on the set UmeN ^-(^m) as follows 

: J^a^l^O'l ^ ^flij-Qj G X(H')- 

This map is linear by construction. It is easy to prove its positivity and boundedness. 
Indeed, by the property of the set {Cy} for an arbitrary operator A G [J m c Z('Hm) there 
exists a subsequence {$ nfc } of the sequence {$„} such that = lim $ nfc (v4). Thus 

positivity and boundedness of the map follows from positivity of the maps in the sequence 
{$ n } and uniform boundedness of these maps. Since the set |J T("H m ) is dense in T(%), the 
map can be extended to a linear positive bounded map from into %(%') (denoted 

by the same symbol 

Show that the map is a limit point of the sequence in the strong operator 

topology. This topology on bounded subsets of £+("%,%') can be determined by countable 
family of seminorms $ t— > \\$>(pi)\\i, where {pi} is an arbitrary countable dense subset of the 
set ©(7^)0 We choose the set of states in \J %{T-L m ) on the role of this subset. An arbitrary 
vicinity of the map contains vicinity of the form 

{$ G £{U,W) | IP - $*)GO||i < e,t = 1^} , 

where }f=i is a finite subset of the above set of states and e > 0. Since {pi t }^ =1 C T(7/ m ) 
for a particular m, the construction of the map implies existence of such subsequence 
{$ nfc } of the sequence {$ n } that $*(pj t ) = lim^+oo $ nfc (pj t ) for all t — l,p. Hence at least 
one element of the sequence {$ n } is contained in the above vicinity. 

Thus the map is a limit point of the sequence {$ n } i n the strong operator topology. 
By metrizability of the strong operator topology on bounded subsets of the cone £+{%,%') 

9 Here the possibility to express an arbitrary operator in T('H) as a linear combination of four states in 
&{%) is used. 
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this implies existence of a subsequence of the sequence {$ n } converging to the map $*. 
Compactness of the set £ is proved. 

2) This assertion immediately follows from the definition of the strong operator topology. 

□ 

6.2 The openness criterion 

Lemma 6. Let ip be a map from a topological space X to a metric space Y . The following 
assertions are equivalent: 

(i) the map ip is open; 

(ii) for arbitrary x G X and arbitrary sequence {y n } C Y , converging to yo = (p(xo), there 
exists a subnet {y nx }\eA of the sequence {y n } and a net {x\}\ e A, converging to xq, 
such that (fi(x\) = y nx for all A G A. 

Proof . (i) =>- (ii) Let It be the set of all vicinities of the point x . Then the set A of all 
pairs A = (U, k), where U G it and k G N, with the partial order 

{Ai = (U u fci) y A 2 = (U 2 , k 2 )} & {h > k 2 and U x C U 2 } 

is directed. For each A = (U, k) the set W\ = <p(U) fl 14, where 14 is the open ball in Y 
with the center yo and radius 1/k, is a vicinity of the point yo- Hence there exists minimal 
natural n\ such that y nx G W\. It is easy to see that {y nx \\ek is a subnet of the sequence 
{y n }- For each A = (U, k) there exists such x\ G U that (p(x\) = y nx . It is clear that the net 
{x\}\e\ converges to Xo- 

(ii) (i) If there exists such open set U C X that the set y?(?7) is not open then there 
exist yo = <p(xo) G (p(U) and sequence {y n } C Y \ (p(U) converging to y . By using (ii) it is 
easy to obtain a contradiction. 

□ 
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